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ABSTRACT 

Three variables which affect students' achievement 
test scores and which can be manipulated prior to test administration 
are discussed: testwiseness, practice tests, and test practice. 
Findings were presented from literature reviews. Regarding 
testwiseness, (1) it can be described, measured, and taught, 
therefore, testwiseness exists; (2) testwiseness is only mildly 
related to general intelligence as measured by group intelligence 
tests and is probably a network cf specific skills, not a general 
cognitive ability; (3) testwiseness increases with maturity and is 
unrelated to sex; (4) although testwiseness skills can be taught to 
students of all ages, using a variety of techniques, the affects of 
such instruction do n-t last long; (5) the differential effects of 
testwiseness instruction for students at various points along the 
testwiseness continuum is unknown and may vary with the type of 
testwiseness skill under consideration; and, (6) for some groups of 
students, testwiseness instruction improves the reliability and 
predictive power of certain tests. No research was found on practice 
tests' effects on student performance or on the reliability or 
predictive power of the associated test. Regarding test practice, it 
was found that taking one IQ test once for practice will improve IQ 
scores on a subsequent test given no more than two months later, and 
.practice effects may last as long as ten months if the posttest is 
\* <the same as or a parallel form to the pretest. (Authcr/GK) 
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t-Li This literature review focuses on three variables which affect students' 

achievement test scores and which can be manipulated prior to test administra- 
tion. They are (1) testwiseness, (2) practice tests, and (3) test practice. 



Testwiseness 

The most commonly used definition of testwiseness is ,! a subject's capacity to 
utilize the characteristics and formats of the test and/or the test-taking 
situation to receive a high score. Testwiseness is logically independent of 
the examinee's knowledge of the subject mattez for which the items are suppos- 
edly measures." (Milinan, Bishop, and Ebel, 1965, p. 707) Testwiseness affects 
scores on standardized tests, and the variance caused by testwiseness becomes 
error variance, i.e., not due to differences in the trait the test seeks to 
meas ure . 

The construct of testwiseness has been documented well in psychometric litera- 
ture. Slakter, Koehler, and Hampton (1970a), Diamond and Evans (1972), and 
Fly nn and Anderson (1977) devised instruments to measure testwiseness. Their 
Instruments for measuring testwiseness consist of nonsense items, that is, items 
based on fictitious material, having no correct answer. However, one option on 
aach item was designated as the "test-wise 11 response because of the cues con- 
tained in the item. For example, 

PERMISSION TO REPROOUCE THIS 

The Davis Act of the 20th Century... materia has be£n granted by 



~ — " — u~ 



a. provided money for schools. 

b. struck down an earlier law. — - 

c. prohibited the manufacture, sale, transportation, or 

use of several specific drugs that were being used t 0 the foucatiokal resources 

---- - r & ° .^FORMATION CENTER <ERIC» 

for illegal puposes. 
d> gave a raise to government employees. 

Response _c is designated as the test-wise response because it is much longer and 
more carefully worded than the other three. In the absence of knowledge, the 
test-wise student would choose response _c. 

\ 

" r Other cues in the nonsense items (Diamond and Evans, 1972, p. 147) include... 

0 

»( . resemblances between stem and correct option, 

<J . grammatical consistency between stem and correct option, 

. specific determiners (words like always and never ) , and 
. options which imply the correctness of each other. 



All of these secondary cues could be used by the test-wise student to spot the 
correct option and/or eliminate incorrect options. 
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If students merely guessed, they would average one test-wise response for every 
four items on the four-choice nonsense test. However, the students in each of 
the three studies — sixth graders, high school seniors, and college students — 
chose the test-wise response on more than half the items on the average. This 
is more than twice the expected success rate from guessing. The students must 
have been responding to secondary cues. 

Further evidence for the existence of testwiseness lies in two facts. 

(1) Students can describe testwiseness (Millman, et al. , 1965; 
and Diamond and Evans, 19 72). 

(2) Testwiseness can be taught (see below). 

Testwiseness apparently bears only a small relationship to intelligence, as 
measured by group intelligence tests. Diamond and Evans (1972) found that 
testwiseness for his sixth-grade subjects was moderately correlated (r = .45) 
to intelligence as measured by the Lorge-Thorndike Intelligence Test. However 
they concluded that testwiseness is cue specific, not a general cognitive 
ability. Kreit (1967) found that IQ level among his third-grade subjects was 
not related to gains in intelligence test scores due to practice. Flynn and 
Anderson (1977) found no relationship between testwiseness and IQ as measured 
by the Thurstone Test of Mental Alertness. They also found that students 1 
levels of testwiseness did not influence their final grade in a course. Dunn 
and Goldstein (1959) found that secondary cue recognition took place equally 
at all levels of intelligence. Jongsma and Warshauer (1975, p. 14) in re- 
viewing the research on testwiseness, concluded that, "The ability to use test- 
taking stracegies is not related to general intelligence as measured by group 
intelligence tests," and testwiseness is not a peneral trait, but "a network 
of specific and independent skills." 

Research by Slakter, Koehler, and Hampton (lS70b) and by Crehan (1974) indi- 
cates that testwiseness increases with age or grade level, but is unrelated to 
sex. Research on the relationship between testwiseness and socioeconomic status 
is scant and inconclusive (Jongsma and Warshauer, 1975). 

Testwiseness can be taught to students of all ages, using a variety of tech- 
niques. Oakland (1972) taught testwiseness skills to Head Start children by 
means of six hours of instruction and practice, spread out over a six-week 
period. Callenbach (1973) found that instruction and practice improved test- 
wiseness skills in second-graders. Jongsma and Warsh auer (1975) taught test- 
wiseness to fifth graders by means of a 45-minute reading and discussion unit. 
Wahlstrom and Boersma (1968) taught testwiseness to ninth graders uy lecture and 
discussion lasting less than two hours. Flynn and Anderson (1977) taught test- 
wiseness to college freshmen by means of taped lectures. Moore (1971) found 
that a booklet familiarizing college students with analogy question formats and 
types of analogies led to improved performance cr* an analogies test. 

In summarizing the research literature, Jongsma and Warshauer (1975) conclude 
that, 

Testwiseness can be effectively taught to students of all ages from 
preschool through adult. Although the results have not always been 
statistically significant, the gains nearly always favor the instruc- 
tional group. (p. 18) 



Most of the instructional units used in research studies have been brief, no 
more than one or two hours in length. They have taken various forms, including 
lecture, self-paced reading, discussion, and programmed instruction. Students 
can acquire considerable test-taking skills rather quickly. On the other hand, 
there is ample evidence in the studies cited above that the positive effects of 
testwiseness instruction do not last very long, probably no more chan a month 
or two. This may be due to forgetting, or it may be due to corstant improve- 
ment in testwiseness skills by all students as they mature. That students 1 
testwiseness skills may increase as a function of maturation is especially sug- 
gested by the Slakter et al., (1970b) and Crehan (197*0 studies cited above. 
Whatever the reason, testwiseness instruction probably needs to be repeated 
before each test administration no maximize its impact. 

Should test-taking skills be taughc in school? Experts on all sides say that 
they should. Researchers such as those we have already discussed favor teach- 
ing testwiseness skills in order to reduce error in test scores. Educators, 
such as Rudman (1976), Erickson (1972), and Downey (1977) are concerned that a 
lack of test-taking skills will adversely affect the predictive and diagnostic 
validity of test scores for individual students. Research by Ginther (1978) 
lends credence to both cases by showing that testwiseness training can favorably 
affect both the reliability and predictive power of some tests for soma groups 
of students. 



As to the predictive and diagnostic validity of test scores for practitioners 1 
purposes, this is a difficult question. What effect would the teaching of 
testwiseness skills have on the interpretation of the scores? Standardized 
tests are norm referenced, by definition. How prevalent is the teaching of 
testwiseness skills to students in the norming sample? We may assume that some 
proportion of students in the norming sample received instruction in testwise- 
ness skills shortly before they took the test. But how large a proportion? 
If the proportion is small, then by teaching all our students testwiseness 
skills, ve can raise the percentile scores and grade equivalents of our local 
students. On the other hand, if the proportion is large, then we underrate our 
own students and instructional staff if we do not teach testwiseness skills. 
Furthermore, if the frequent teaching of testwiseness skills to all students 
becomes standard educational practice, then the next time new tests are normed, 
the norms may be more demanding since the test-taking skills of the average 
student would have been upgraded. 

Now let us examine the issue of reducing error in test scores. The researchers 
cited above generally agree that instruction in test-taking skills would reduce 
such error. However, is this necessarily the case? 

Observed test scores can be viewed as the sum of the student's true score on 
the one hand and some amount of measurement error on the other hand. Measure- 
ment errcr can be caused by many factors including variations in t^st construc- 
tion, test-taking conditions, and testwiseness. The assumption by the researchers 
seems to be that teaching testwiseness iu the schools will yield observed scores 
closer to the true scores by reducing variations in testwiseness as a result of 
upgrading the skills of the relatively test-naive subjects. 

There are, however, indications in the literature, such as in the Flynn and 
Anderson (1977) study, that testwiseness instruction may benefit all students 
equally, regardless df their initial level of testwiseness skills. To the 
extant that this is true, it would negate the hope that variations in test- 
wiseness could be reduced by teaching all students testwiseness skills. The 
range of variation in testwiseness skills might remain the same. While the 
test-taking skills of the relatively test-naive students would be upgraded 
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through instruction, so would the skills of the highly test-wise students. It 
is conceivable that students might have such a high degree of test-taking skill 
that they are able to "outsmart" the test and receive an observed score that 
overestimates the students 1 abilities. This is certainly measurement error, 
and Flynn and Anderson's finding suggests that this type of error would be 
exacerbated by teaching testwiseness to all students. Thus, under certain cir- 
cumstances, instruction in testwiseness may actually increase measurement error 
in the test scores of some students. 

At this point, a distinction is helpful between two types of testwiseness skills. 
First, basic testwiseness skills include marking answers properly, using avail- 
able time efficiently, following directions, etc. Basic testwiseness skills 
help reduce the error in test scores. Second, advanced testwiseness skills 
include choosing the grammatically correct alternative, avoiding options with 
"always 11 and "never," etc. Advanced skills should seldom be advantageous on a 
well-constructed, standardized test. Thus, the actual chance of impacting error 
variance on a major standardized test by teaching ad\anced testwiseness skills 
appears to be small. 

Future research could make a significant contribution to educational practitioners 
by determining the comparative effects of testwiseness instruction. Do the re- 
latively test-wise always gain as much froir testwiseness instruction as the test- 
naive? If not, under what conditions would the test-naive students gain more 
than the test-wise? Possibly, Flynn and Anderson's finding that all students 
benefited equally from testwiseness instruction reflects the fact that advanced 
testwiseness skills were taught in that study* If only basic strategies had 
been taught, differential gains might have been observed. 

Teaching testwiseness skills only to those students who are deficient in such 
skills would address all the difficulties outlined above. This strategy would 
reduce the range of testwiseness skills, upgrade the skills of the test-naive 
without producing students who could outsmart the test, and have a less trouble- 
some effect on the norms than would the strategy of teaching testwiseness skills 
to all students. 

In a public school setting, however, it may be difficult to put this strategy into 
practice. In the first place, it would be expensive to target the test-naive 
students. New measures would have to be designed, normed, and administered, 
and criterion scores established in order to decide who needs testwiseness 
skills and who does not. In the second place, it is often difficult for public 
schools to convince parents that it is equitable to offer ceitain educational 
services and resources only to selected students and not to all. 

Assuming that testwiseness is to be taught, what specifically should be taught, 
and how? Millman, et al., (1965) provide a comprehensive outline of the skills 
and strategies involved in testwiseness. There is no shortage of suggestions 
on what to teach and how (Rudman, 1976; Erickson, 1972; and Downey, 1977), but 
a single approach will not work for all grade levels. Students gain in test- 
wiseness and in rht_r ability to grasp testwiseness strategies as they mature 
and gain experience in test-taking. For the purposes of this review* Jongsma's 
and Warshauer's summation may be best (p. 39). 

Teach those aspects of testwiseness that appear appropriate for 
your age group. For younger students this might involve such 
features as following directions, completing answer sheets, and 
guessing. Older students might profit from more sophisticated 
skills such as using secondary cues or practicing with particular 
formats. 



Use an instructional format that you believe is eff ective. . .There 
is no research to support one type of instruction over another... 
Providing concrete examples to illustrate test-taking cues would 
be advisable. 

Repeat instruction in testwiseness. ♦ .prior to subsequent stan- 
dardized test administrations . 

Oakland's (1972) research suggests that very young students may need to be 
taught basic concepts, such as right, left, up, down, opposite, most like, 
same* a. d different (p. 357). 

Future research on testwiseness can make the best contribution to both theory 
and practice by devoting itself to the question of how best to reduce the mea- 
surement error caused by individual differences in test-taking skills. Also, 
the relationship between testwiseness and socioeconomic status is open for 
investigation. Preliminary indications (Jongsma and Warshauer, 1975) are that SES 
may interact with testwiseness instruction in improving test-taking skills. 



Practice Tests 

A distinction needs to be made between the terms "practice tests," and ,! test 
practice. 11 The term practice tests, as used here, refers to packets of exer- 
cises for students, designed by test-makers or school personnel, which are 
much shorter in length than the standardized tests to which they relate, and 
with items typically much easier than the items on the accual test. 

Practice tests are usually desigred to 

v 

(1) familiarize students with the visual format of the test, 

(2) familiarize students with the terminology used in the test 
instructions, 

(3) provide students with practice in using separate answer sheets, 
and 

(4) ease students 1 fear of the test. 

The authors of this paper were unable to find any research bearing on practice 
tests ant their effects on student performance outcomes or on the reliability 
or predictive ppwer of the associated test. 



Test Practice 

Let us define "test practice" as the use of full-length, standardized tests as 
practice exercises prior to the administration of a standardized test for offi- 
cial purposes . ^ 

Especially where intelligence and aptitude tests are concerned, there is ample 
research related to the effects of test practice on test scores. The findings 
regarding intelligence tests axe remarkably consistent. Three separate reseachers 
(Peel, 1952; Kreit, 1967; and Eichelberger , 1970) have found that one and only 
one test practice session, within one month of the official test, will improve 
IQ scores. Any further test practice is useless, they conclude, because a second 
or third practice session does not affect IQ scores, regardless of the time in- 
terval between test practice and the official test. If the interval is more 
than two months, the official test scores probably will be unaffected by test 
practice. Nero (1976) found with an aptitude battery that practicp. effects 
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lingered for as much as ten months if the posttest was either the same as the 
pretest or a parallel form. Nero's study further shows that improved perfor- 
mance based on test practice does not result from repetition (at least at 10- 
month intervals), but results instead from subjects 1 being familiar with the 
specific format of the test. 



Summary 

The following statements summarize findings from the literature reviewed. 
Tes twiseness 

(1) Testwiseness can be described, measured, and taught; therefore, 
testwiseness exists . 

(2) Testwiseness is only mildly related to general intelligence as 
measured by group intelligence tests and is probably a network 
of specific skills, not a general cognitive ability. 

(3) Testwiseness increases with maturity and is unrelated to sex* 

(4) Although testwiseness skills can be taught to students of all 
ages, ubing a variety of techniquas, the affects of such instruc- 
tion do not last long. Therefore, such instruction must :ake 
place within two months of the actual test administration in 
order to have its maximum impact. 

(5) The differential effects of testwiseness instruction for 
students at various points along the testwiseness continuum 
is unknown and may vary with the type of testwiseness skill 
(basic or advanced) under consideration. 

(6) For some groups of students testwiseness instruction improves 
the reliability and predictive power of certain tests. 



Practice Tests 

No research was found on practice tests 1 effects on student performance or on 
the reliability or predictive power of the associated test. 



Test Practice 

(1) Taking one IQ test once for practice will improve IQ scores 
on a subsequent test given no more than two months later. 

Any more Lest practice than this produces no more improvement. 

(2) Practice effects may last as long as ten months if the post- 
test is the same as or a parallel form to the pretest. 
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